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SYSTEM AND METHOD FOR COMPUTER ANALYSIS OF 
COMPUTER GENERATED COMMUNICATIONS TO PRODUCE 
INDICATIONS AND WARNING OF DANGEROUS BEHAVIOR 

BACKGROUND OF THE INVENTION 

Field of the Invention 
[0001] The present invention relates to systems and 
methods for analyzing computer generated communications. 

Description of the Prior Art 
[0002] Psychological profiling algorithms have been 
developed based upon the work of Weintraub. Weintraub has 
identified 14 critical speech categories, set forth in Fig. 1, 
which are believed by psychologists to reflect the operation of 
psychological coping mechanisms or defenses. Weintraub 's 
opinion is that the distribution of these variables indicate 
the distribution of defenses in an individual and provides 
insight into the individual's psychological state or 
personality. Weintraub 's and his colleague's original research 
dates from 19 64. 

[0003] This original research demonstrated differences in 
the distribution of these categories of speech as used by 
normal persons and persons with different forms of psycho- 
pathology, including depression, impulsiveness, delusions and 
compulsiveness . Weintraub profiled and compared political 
leaders, such as participants in Watergate in 1981. In 1989, 
he extended his methodology for leadership profiling to the 



assessment and comparison of U.S. Presidents, including 
Eisenhower, Kennedy, Johnson, Nixon, Ford, Carter and Reagan. 

[0004] Over the past 35 years, Weintraub's algorithms 
have also been used to analyze the speech and written products 
of leaders to develop in-depth psychological profiles of these 
individuals and comparisons between them. Weintraub has also 
discussed providing computerized portions of his algorithms to 
expedite the analytical process. 

[0005] However, Weintraub's algorithms are not known by 
the public to have been applied to the evaluations of changes 
in an individual's psychological state over time; the 
communications of normal employees in the workplace; to 
computer generated communications, e.g. email and chat; 
generating a warning of a potentially dangerous change in an 
individual's psychological state; or self-monitoring of 
psychological state. 

[0006] The Weintraub algorithms quantify the number of 
words in the above-referenced speech categories of Fig. 1. The 
total word count for each category may be multiplied by a 
corrective figure which is obtained by dividing 1,000 by the 
number of words in the sample and rounding off to three decimal 
places to provide a normalized basis for comparison. 

[0007] The Weintraub algorithms may be used to profile the 
following psychological states : 

[0008] 1. Indicators of Anger- 
Increases in the number of: 
• words ; 
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• personal references; 

• negatives ; 

• evaluators; 

• statements of feeling; 

• direct references; 

• rhetorical questions; 

• interruptions; 

• I ; and 

• We 

Decreases in the number of: 

• qualifiers; and 

• retractors. 



[0009] 2. Indicators of Anxiety - 

• -Increases in the number of: 

• retractors ; 

• qualifiers; 

• expressions of feeling; 

• negatives; and 

• explainers . 

[0010] 3. Indicators of Depression 

• decreased number of words 

• increased I 

• increased me 

• increased negative key words 

• increased direct references 



3 



increased expressions of feeling key words 

increased evaluators 

increased adverbial intensifiers 



[0011] 4, Indicators of Emotional withdrawal- 

• decreased number of words; 

• decreased number of communications; 

• decreased I score; 

• decreased personal references; 

• decreased expressions of feelings; and 

• decreased evaluators. 

[0012] 5. Indicators of Rigidity or lack of flexibility- 

• decreased number of qualifiers; 

• decreased number of retractors; 

• decreased we's; 

• increased I's; 

• decreased explainers; 

• increased evaluators; and 

• increased adverbial intensifiers. 

[0013] 6. Indicators of Impulsiveness- 

• increased retractors and 

• increased expressions of feeling. 
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[0014] 7. Indicators of Emotional instability- 

• increased I-to-We ratio; 

• increased adverbial intensifiers 

• increased direct references 

• increased expression of feelings 

• increased evaluators . 

[0015] Score Interpretations of Weintraub's psychological 
profiling algorithms have been suggested as follows: 



[0016] 1. I scores: 

• high I score — self-preoccupied 

• moderate I — healthy ability to commit self in 
thought and action while maintaining degree of 
autonomy ; 

• low I — avoidance of candor, intimacy, commitment. 



[0017] 2. We scores: 

• moderate score — healthy capacity to recognize and 
collaborate with others 

• high we + low I — avoidance of intimacy and 
commitment . 



[0018] 3. Me: 

• high use reflects dependence and passivity. 

[0019] 4. Negatives: 

• high scores associated with stubbornness, 
oppositionality , anger, sue of denial as defense 
mechanism. 
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[0020] 5. Qualifiers 

• low score — dogmatism — over-certainty, rigidity. 

• high score — lack of decisiveness, avoidance of 
commitment 

• very high score — anxiety 

[0021] 6. Retractors 

• high score — difficulty adhering to previous 
decisions, impulsiveness 

• moderate — mature capacity to reconsider, 
flexibility, openness to new possibility. 

• very low — dogmatism, rigidity. 

[0022] 7. Direct References 

• high scores — difficulty with correspondence or 
conversation, seeking to distract or manipulate 

• low or absent — shyness, aloofness, anxiety 

[002 3] 8. Explainers 

• high — use of rationalization 

• low or absent — dogmatism, rigidity 

[0024] 9. Expressions of Feeling 

• low score — aloofness, hesitant to share feelings, 
trust 

• high score — insincere, histrionic 

[002 5] 10. Evaluators 

• high scores — severe or troubled conscience, 
psychopathology, anger, dogmatism, rigidity 

• Low scores — fear of intimacy, lack of commitment 
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[002 6] 11. Adverbial Intensifiers 



• high scores indicate histrionic personality, 
exaggeration, rigidity, judgmental 

[0027] 12. Rhetorical Questions — increase anger and an 
effort to control the dialogue 

[0028] 13. Interruptions — increased anger and an effort 
to dominate 

[0029] The specialized composite scores with relevance 
for personalrelationships, organizational behavior 
and leadership include remain unpublished but 
include: 

• emotionally controlled — low anxiety and depression 
scores 

• sensitivity to criticism — high negatives + high 
explainers + high I + me. 

•accommodating versus rivalrous-low to moderate 
negatives and moderate to high retractors 

• oppositional-high negatives score. 

• controlling in relationships — low score on 
negatives, feelings, evaluators, and qualifiers. 

• passive vs. active — high me score. 

• planner vs. reactor — high I+we: me ratio. 

• decisiveness — low to moderate qualifiers. 

• unrealistic — high negatives. 

• high need for others — high we. 

• high need for achievement — high I+We, low me, low 
qualifiers . 

• dependent-high me plus high evaluators, negatives, 
feelings . 

• well organized — high I+we, low me, low qualifiers, 
low evaluators, ow feelings, low negatives. 

• narcissistic — high negatives + high explainers + 
high evaluators, high I, low qualifiers. 
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• obsessive — high evaluators + high negatives + low 
retractors, low me, low qualifiers, low feielings 

• paranoid — high negatives, high explainers, low 
retractors . 

• loner vs. team player — high I, low we or I: We. 

[0030] Beginning in the late 1950 's, Gottschalk 
demonstrated that the arousal associated with psychological 
events plays an important role in the occurrence of epileptic 
seizures in children and later (1955) in adults. While working 
at the National Institute of Mental Health, Gottschalk and his 
colleagues explored differences in the effects of different 
forms of stimulation on speech variables, such as rate, 
frequency, duration of pauses, grammatical categories and parts 
of speech (Gottschalk and Hambridge, 1955) . Later, Gottschalk 
and his colleagues examined differences in speech between 
psychotic and non-psychotic patients (Gottschalk, Glessner and 
Hambridge, 1957) . In 1958, Gottschalk conducted a time series 
analysis of the verbal behavior of a single psychoanalytic 
patient to determine any possible effects of the therapy 
(Hambridge and Gottschalk, 1958) . 

[0031] In the 1960 's, Gottschalk worked with Dr. Golding 
Glenser at the University of Cincinnati. This work identified 
variations in the use of parts of speech by normal individuals 
according to gender and intelligence (for example, Gleser, 
Gottschalk and John 1959; Gottschalk and Gleser, 19 64) . 
Gottshalk and Gleser (1960) also used their content analysis 
method to distinguish genuine from pseudo-suicide notes. By 
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the end of the 1960 's, Gotschalk and his colleagues added new 
complexity to their content analysis method by moving from the 
analysis of individual words to more complex phrases. In 1969, 
Gottshalk and Gleser described a method for determining an 
individual's psychological state (anxiety, hostility, 
alienation, and disorganization) from brief samples of speech 
(Gottshalk and Gleser 1969) . Gottschalk, Wingate and Glesner 
(1969), have described their content analysis scales in a 
scoring manual. Since 1969, Gottschalk and colleagues have 
applied their methods to the study of medical conditions, 
medications, treatment, and psychological conditions on 
children and adolescents and adults. This work has been 
summarized in Gottschalk (1995) . 

[0032] Gottshalk and his colleagues have computerized 
their content analytical scales in order to make them more 
efficient and more widely available to other researchers. 
These efforts are also described in Gottschalk (199 5, pgs. 157- 
160) . 

[003 3] Gottschalk and his colleagues have produced a 
content analytical system that can detect emotional states and 
changes in emotional states in individuals as a result of a 
wide range of psychological and medical conditions and 
treatments. The have also measured changes in these states in 
individuals over time and designed a computerized version of 
the system. 

[0034] However, Gottschalk and his colleagues have not 
utilized their algorithms regarding communications of normal 
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employees in the work place, computer generated communications, 
e.g. email and chat, the generation of a warning of a 
potentially dangerous change in an individual's psychological 
state or self -monitoring of a psychological state. 

[003 5] Margaret Hermann, over the last 25 years, has used 
content analysis for psychological profiling. In 1977, Herman 
(with Thomas Milburn) edited an academic collection entitled 
"A Psychological Examination of Political Leaders", (New York 
Free Press 1977) . This text brought together the work of 
psychologists and political scientists interested in the remote 
assessment of leadership characteristics utilizing content 
analysis of the leader's speech and writings. It also contains 
chapters by political-psychological profilers on the history 
and different approaches to political psychological content 
analysis, including Value Analysis (White 1951) , Evaluation 
Assertion Analysis (Osgood 1959), the Psychologic (Shneidman 
1961, 1963) , General Inquirer (Stone, Dunphy, Smith and Ogilvie 
1966), and Mode of Imagery (Winter 1973). Hermann, in 1977, in 
a chapter entitled, "Vocal Behavior of Negotiators in Periods 
of High and Low Stress: the 1965-1966 New York City Transit 
Negotiations," described a content analytical system that 
analyzed the psychological state of political leaders involved 
over a time and in different stress states. The collection of 
content analytical measures drew on the previous work of 
psychologists, political scientists and others interested in 
the assessment of emotional states and their changes over time. 
In another chapter in the same text, she described three 
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content analysis systems designed to assess a leader's beliefs, 
motives, decision-making and interpersonal style as it might 
affect their attitude toward foreign aid. These personal 
characteristics included optimism, cognitive complexity, and 
humanitarian ideology. The results of the study related 
variation in these characteristics to the policy positions 
taken by the leaders examined. Both Herman and her colleagues 
have refined and expanded the number of personal 
characteristics derived from content analysis of a leader's 
speeches or interviews and detailed their effects on a leader's 
foreign policy orientation and likely political behavior. The 
personal characteristics of nationalism, belief in one's 
ability to control events, need for power, need for 
affiliation, conceptual complexity, self-confidence, distrust 
of others, and task orientation, have been applied to over 100 
domestic and foreign political leaders, including heads of 
states and leaders of revolutionary and terrorist 
organizations . 

[003 6] Hermann uses scores obtained on a leader for each 
of the aforementioned eight personal characteristics and uses 
them to classify the leader in terms of six possible foreign 
policy orientations, including expansionist, active 
independent, influential, opportunist, mediator and 
developmental. Each of the orientation types can be expected 
to differ in world view, political style, decision-making 
process manner of dealing with political rivals, and in view of 
foreign policy. 
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[003 7] Hermann has designed computerized approaches to 
her content analytical system. However, complexity of coding 
required to produce measures for many of the characteristics 
have limited validity and reliability of the resultant 
automated process. 

[0038] In summary, Hermann has designed a content 
analysis system to assess the motives, beliefs, decision-making 
and interpersonal style of political leaders. She has applied 
this system to the in-depth profiling of subjects, comparison 
with other leaders, and the assessment of the dynamics of 
leadership groups determined by member differences. She has 
also used the system to analyze a leader's reaction to 
distress . 

[0039] However, Herman has not applied her system to the 
communications of normal employees in the work place, computer 
generated communications, e.g. email and chat; the task of 
generating a warning of a potentially dangerous change in an 
individual's psychological state; or self -monitoring of a 
psychological state. 

[0040] Another measure of psychological state is 
described in Mehrabian and Wiener (19 66) which is identified 
herein as "Psychological Distance". Psychological distance is 
an emotional state expressed by the speaker toward a target, 
individual or group. Because the speaker normally 
unconsciously selects the semantic structures used to calculate 
psychological distance, it is an excellent measure of "covert" 
attitude. When a speaker's covert attitude, as measured by 
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psychological distances, is compared with overt content of a 
speaker's remarks (the number of negative, positive or neutral 
words associated with the name of an individual or group) , it 
becomes a reliable measure of deception or bluffing. For 
example, if the overt attitude toward the person or group is 
positive and the covert attitude is negative, this is an 
indicator of deception. If the covert attitude towards the 
group or individual is more positive than the overt attitude, 
this is an indicator of bluffing. 

[0041] Psychological distance is scored according to the 
following guidelines. First, each reference by the speaker to 
the target is identified. Second, the word structures around 
the reference to the target are evaluated for the presence or 
absence of each of the nine conditions below. Third, for each 
time one of these nine conditions is present^ a single score is 
received. Fourth, for each communication, an average 
psychological distance score is constructed by taking the 
number of references to the target divided by the number of 
points received in the communication across all references to 
the target. This score is usually between one and nine with 
the higher score indicating the presence of greater hostility 
or psychological distance. 

[0042] 

Psychological Distance Coding Guideline 

[004 3] 1. Spatial : the communicator refers to the 
object of communication using demonstrative pronouns such as 
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"that" or "those." E.g. "those people need help" versus "these 
people need help." 

[0044] 2. Temporal : the communicator's relationship with 
the object of communication is either temporally past or 
future. E.g., "X has been showing me his house" versus "X is 
showing me his house." 

[0045] 3. Passivity : the relationship between the 
communicator and the object of communication is imposed on 
either or both of them. E.g., "I have to see X" versus "I want 
to see X. " 

[0046] 4. Unilaterally : the relationship between 
communicator and the object of communication is not mutually 
determined. E.g., "I am dancing with X" versus "X and I are 
dancing. " 

[0047] 5. Possibility ; the relationship between the 
communicator and the object of communication is possible rather 
than actual. E.g., "I could see X" versus "I want to see X." 

[0048] 6. Part (of Communicator) ; only a part, aspect, 
or characteristic of the communicator is involved in the 
relationship with the object of communication. E.g. , "My 
thoughts are about X" versus "I am thinking of X." 
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[0049] 7. Object (Part of Object) ; only a part, aspect, 
or characteristic of the object of communication is involved in 
the relationship with the communicator. E.g., "I am concerned 
about X's future" versus "I am concerned about X." 

[0050] 8. Class (of Communicator) ; a group of people who 
include the communicator is related to the object of 
communication. E.g., "X came to visit us" versus "X came to 
visit me. " 

[0051] 9. Class (of Object) : the object of communication 
is related to as a group of objects, which includes the object 
of communication, e.g., "I visited X and his wife" versus "I 
visited X. " 

[0052] In December 1999, at pages 43-44, in Security 

Management, it was stated: 

"The [inventor's] firm, has developed psycho- 
linguistic measures sensitive to changes in an 
employee's psychological state indicative of 
increased risk. In the case of the employee who 
abruptly changes tone in his email messages, post hoc 
use of these measures detected both the employee ' s 
initial disgruntlement and the contrast between his 
overt and covert activities. Had these automated 
measures been monitored by security, this incident 
might have been prevented" . 

[0053] Figs. 2-5 illustrate slides presented by the 
inventor at conferences on May 12, 1999, June 17, 1999, 
July 28, 1999, and October 20, 1999 to persons involved with 
the security industry which analyzed the electronic mail 
messages of an actual perpetrator of a computer crime. The 
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mean prior values of the number of "negatives", as illustrated 
in Fig. 2, the number of "evaluators" as illustrated in Fig. 3, 
the "number of words per email", as illustrated in Fig. 4, and 
the "number of alert phrases" as illustrated in Fig. 5 were 
compared to the values obtained from analysis of an electronic 
mail message prior to and associated with the crime in 
question. The increase over the mean values was discussed as 
indicating the risk of the criminal activity in question. The 
slides of Figs. 2-5 represent the inventor's analytical 
analysis after the crime occurred of emails of the perpetrator 
of the crime in question and were not produced at the time of 
the crime or at the time of the conferences by the present 
invention. 

[0054] Fig. 6 illustrates a slide presented by the 
inventor at the aforementioned conferences analyzing continued 
covert hostility versus psychological distance over time. As 
time passed, the criminal whose activities are analyzed above 
in Figs. 2-5, deceived his supervisor with "charming 
pleasantries" as the attack was prepared. Prior art email 
screening techniques would also have been deceived by the 
activities of the criminal. As is shown in Fig. 6, a continued 
high degree of psychological distance was exhibited in emails 
after the plan of the attack was occurring. This graph was 
produced by the analytical analysis of the author, was not 
produced by an analysis of the criminal's activity as events 
unfolded and was not produced with the present invention. 
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[0055] Fig. 7 illustrates another slide provided by the 
inventor at the aforementioned conferences illustrating 
indicators of psychological distance versus overt attitude 
consistent with deception. Again, as is seen, the 
aforementioned conduct of the prior art of Figs. 2-6 show a 
drop in overt hostility from three months to two weeks prior to 
the crime which deceived the criminal's supervisor while the 
analysis, as depicted in Fig. 6, shows a more or less constant 
continued covert hostility. The graph of Fig, 7 was produced 
by the inventor's analytical analysis and was not produced with 
the present invention. 

[0056] Email -monitored software for the securities 
industry has been developed as a result of a SEC order that 
brokerage houses monitor their sales force for illegal sales 
practices. This software detects key words indicative of 
potential trading sales violations. 

[0057] As a result of the increased employee use of 
information technology, non-psychological systems of employee 
monitoring have emerged which are designed to protect companies 
from employee misuse or other threats. These systems are 
operated by companies to monitor employee use of information 
technology to detect patterns involving unauthorized visits to 
internet sites; errors in the use of software requiring 
additional training; and visits by email or other 
communications to or from unauthorized sites within and 
external to the organization. 
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[0058] In addition, systems exist to detect occurrence of 
"keywords" indicative of possible violations of law (the above- 
referenced security industries practice) and regulations or the 
existence of possible security violations. 

[0059] Other systems screen incoming and outgoing 
communications for the existence of dangerous viruses and/ or 
other destructive content. However, none of these systems 
currently assess the psychological state of an employee to 
generate an indicator of risk. 

SUMMj^Y OF THE INVENTION 

[0060] The present invention is a method and system of 
computer analysis of computer generated communications which 
provides real time analysis and output communications to 
facilitate organizational and individual actions when a 
programmed and selectable psychological state of an author who 
originates or receives computer generated communications is 
detected to which a responsive action should be taken. As a 
result, corrective action to an individual's projected course 
of behavior or the content of a proposed computer generated 
communication can be taken to lessen or eliminate that behavior 
to enhance safety and the operation of an organization to which 
the author is affiliated or to provide the author or someone 
else with the ability to alter the effect a computer generated 
communication will have when transmitted. 

[0061] At least one computer generated communication 
produced by or received by an author is collected; the 
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collected at least one computer generated communication is 
parsed to identify categories of information therein; and the 
categories of information are processed with at least one 
analysis to quantify at least one type of information in each 
category, such as specific words and word phrases which provide 
information about psychological state of the author and are 
sensitive indicators of the changes in the psychological state 
of the author. An output communication is generated when the 
quantification of at least one type of information for at least 
one category differs from a reference for the at least one 
category by at least a criteria involving a psychological state 
of the author in response to which it would be wise or 
beneficial to take a responsive action. The content of the 
output communication and the criteria are programmable to 
define when an action should be taken in response to the 
psychological state and a suggested action (a warning, 
counseling or otherwise) to be taken in response to the 
psychological state. A plurality of computer generated 
communications generated over a period of time may be 
collected, parsed and processed to generate the reference of 
the at least one type of information for each category. A more 
recent computer generated communication may be collected and 
parsed to quantify the at least one type of information therein 
for each category with the output communication being generated 
when a comparison of the reference based upon previous computer 
generated communications of the at least one category and the 
quantification of the current computer generated communication 
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for at least one category reveals a change which differs from 
the reference from the at least one category by the criteria. 

[0062] The plurality of analysis may comprise a 
psychological profiling algorithm which provides an indication 
of psychological state of the author, at least one key word 
algorithm which processes any phrases and/or threatening acts 
to further identify a psychological state of the author and how 
the author may react to the identified psychological state and 
at least one message characteristicalgorithm which analyzes 
characteristics of the at least one computer generated 
communication to further identify a psychological state and/or 
at least one possible action of the author. 

[0063] The output communication may be programmed to be 
varied in nature to address diverse applications of the 
invention. The programming of the content of the output 
communication and the actions to be taken permits users of the 
invention to customize the criteria for screening computer 
generated communications to detect those computer generated 
communications which the user deems important enough to provide 
a responsive action and further the nature of the action to be 
taken, such as a written warning or the invoking of 
psychological counseling, to minimize or eliminate disruptive 
or dangerous situations. For example, the output communication 
may be a warning with the programmed criteria for generating 
the warning being selected by a user. For example, the warning 
may be generated only if a significant quantification of words 
of at least one computer generated communication produced by or 
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received by the author fall within identified categories of 
information or a significant change over time occurs between an 
average, mean or other calculation or otherwise quantification 
of previous computer generated communications received or 
prepared by the author and a more recent computer generated 
communication is detected. 

[0054] In response to detection of that action, a 
qualified professional may be automatically contacted by 
telephone, email or otherwise, and assigned to assess the 
psychological state of the author reflected in at least one 
computer generated communication. The professional may be 
given the option to review the data generated from the at least 
one computer generated communication, determine if a warning 
should be given, and to further conduct analysis of the change 
detected to determine the significance thereof. This may be 
done with or without actual review of the content of the 
message. If actual review of the data is required by the 
professional, access to the database storing the results of the 
quantification of the at least one type of information in each 
category of review may be provided online or otherwise. 

[0065] User's of the invention will have options, 
including monitoring designated categories of employees, 
monitoring employees at risk or under suspension, and general 
monitoring. 

[0066] For example, in organizations sensitive positions 
of trust exist where the employee has the capacity to 
significantly damage the organization. For example, system 
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administrators running a bank's on-line customer service 
operations or other information technology have the capacity to 
substantially damage the bank at will. Therefore, it is 
desirable that administrators having responsibility for 
critical business infrastructure be subject to higher levels of 
monitoring- 

[0067] The invention permits the user to program the 
criteria involving a psychological state of the author and the 
content of the output communication. Different levels of 
monitoring accompanied with output communications designed 
specifically for the sensitivity of author's positions are 
selectable. For example, accountant's have different access to 
damage a company than technical support staff, such as IT 
professionals, which differences are reflected in the 
programming. Determination of the criteria when the content of 
computer generated communications exceeds the standard of 
review are also programmable. 

[0068] Employees at risk or under suspension may include 
individuals on probation due to psychological or behavioral 
difficulties that do not yet merit removal from the workplace 
or individuals who are returning from leave or rehabilitation 
after removal due to these difficulties. This type of employee 
may include individuals under investigation for violation. 

[0069] A self-monitoring embodiment uses the 
psychological profiling algorithms discussed above and below to 
produce graphics or tabular ratings of the content of a 
computer generated communication scoring for emotional tone. 
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Thereafter, the embodiment produces recommendations for 
corrective actions to change the emotional tone which permits 
the author to again use the psychological profiling algorithms 
on the changed computer generated communication to check for 
improvement in a desired (programmable) emotional scale. 

[0070] A method of computer analysis of computer 
generated communications in accordance with the invention 
includes collecting at least one computer generated 
communication produced by or received by an author; parsing the 
collected at least one computer generated communication to 
identify categories of information therein; processing the 
categories of information with at least one analysis to 
quantify at least one type of information in each category; and 
generating an output communication when a difference between 
the quantification of at least one type of information for at 
least one category and a reference for the at least one 
category is detected involving a psychological state of the 
author to which a responsive action should be taken with 
content of the output communication and the at least one 
category being programmable to define a psychological state in 
response to which an action should be taken and what the action 
is to be taken in response to the defined psychological state. 
The method further may include a plurality of computer 
generated communications generated over a period of time which 
are collected, parsed and processed to generate the reference 
of the at least one type of information for each category; 
collecting, parsing and processing a more recent computer 
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generated communication to quantify the at least one type of 
information therein for each category; and generating the 
output communication when the difference between the reference 
of at least one category and the quantification of the current 
computer generated communication for at least one category is 
detected involving a psychological state of the author to which 
the responsive action should be taken. Only one computer 
generated communication may be collected, parsed and processed. 
The output communication may indicate that the author should be 
studied. One or more analyses may be used to process the 
categories of information with the analyses including one or 
more a psychological profiling algorithm which provides an 
indication of a psychological state of the author, at least one 
key word algorithm which processes any phrases and/ or 
threatening acts to further identify a psychological state of 
the author and how the author may react to the identified 
psychological state and at least one message 

characteristicalgorithm which analyzes characteristics of the 
at least one computer generated communication to identify a 
psychological state and/or at least one possible action of the 
author. The at least one computer generated communication may 
be collected by an organization to which the author is 
affiliated; and the output communication may be present on a 
system of the organization and is directed to or from the 
organization. Each reference may be set by the organization. 
Only one computer generated communication may be collected by 
an organization to which the author is affiliated; and the 
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output communication may be directed to the organization and 
pertains to further action to be taken regarding the author. 
Each reference may be static and indicative that a 
psychological state of the author is of concern to the 
organization. The collected at least one computer generated 
communication may be email, chat from a chat room or website 
information collected from a website. The output communication 
may assess a risk posed by the author based upon the at least 
one computer generated communication produced or received by 
the author. The author may be affiliated with an organization; 
and the output communication may pertain to a course of action 
to be taken by the organization which collected the at least 
one computer generated communication authored or received by 
the author. The output communication may be about the author; 
and the output communication may be generated in response to 
processing of the reference for the at least one psychological 
profiling algorithm and the guantif ication produced by the 
psychological profiling algorithm, may be generated in response 
to processing of the reference for the at least one key word 
algorithm and the quantification produced by the at least one 
key word algorithm, or may be generated in response to a 
comparison of the reference for the at least one message 
characteristicalgorithm and the quantification produced by the 
at least one message characteristicalgorithm. The output 
communication may regard at least one of a psychological state 
of the author represented in the at least one computer 
generated communication and an investigation of the 
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psychological state of the author represented by the at least 
one computer generated communication. The at least one 
psychological profiling algorithm may quantify at least one of: 
words written in bold face, italics,- profanity or email 
symbols in an alert phrase. The at least one psychological 
profiling algorithm may quantify the following words, phrases, 
or subjects: I, we, me negatives, quantifiers, retractors, 
direct references, explainers, expressions of feeling, 
evaluators, adverbial intensif iers , rhetorical questions, 
interruptions, interrogatives and imperatives. The at least 
one psychological profiling algorithm produces an assessment of 
a psychological state of the author. The psychological state 
of the author may be at least one of anger, anxiety, 
depression, emotional withdrawal, lack of flexibility, 
impulsiveness and emotional stability. The at least one key 
word algorithm may provide an interpretation of the 
psychological state and/or risk of at least one of or a 
combination of the words, phrases and subjects represented by 
the at least one computer generated communication. The at 
least one key word algorithm may quantify phrases and/or 
threatening acts to identify a psychological state. The 
phrases and/or threatening acts may involve at least one of 
anger, grief, threats, or accusations. The at least one key 
word algorithm may provide information regarding at least one 
of: employee attitude, actions toward individuals, at least 
one organization and at least one organizational interest. The 
message characteristics algorithms of the at least one computer 
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generated communication may include at least one of the 
following information about the at least one computer generated 
communication: number of words, time of day, writing time, 
number of words per minute, recipient, spelling errors, 
grammatical errors, words per sentence, and communication rate 
in terms of at least one of a number of computer generated 
communications per hour or day. The output communication may 
be used to alter the at least one computer generated 
communication. In the self -monitoring version, the author may 
use the output communication to alter the at least one computer 
generated communication. The altering of the at least one 
computer generated communication may modify a psychological 
state reflected in the at least one computer generated 
communication in a manner desired by the author. The category 
involving psychological state may be a change in psychological 
state. 

[0071] A system which provides computer analysis of 
computer generated communications in accordance with the 
invention includes a computer system having at least one 
processor, a database coupled to the at least one processor and 
an input which collects at least one computer generated 
communication produced by or received by an author; a parser, 
executed by the at least one processor, which parses the 
collected at least one computer generated communication to 
identify categories of information therein; the at least one 
processor performs at least one analysis of one of the 
categories of information to quantify at least one type of 
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information in each category which is stored in the database; 
and the at least one processor generates an output 
communication when a difference between the quantification of 
at least one type of information for at least one category and 
a reference for the at least one category is detected involving 
a psychological state of the author to which a responsive 
action should be taken with content of the output communication 
and the at least one category being programmable to define a 
psychological state in response to which an action should be 
taken and what the action is to be taken in response to the 
defined psychological state. The at least one analysis may be 
at least one algorithm. The at least one analysis may comprise 
at least one of a psychological profiling algorithm which 
provides an indication of a psychological state of the author, 
at least one key word algorithm which processes any phrases 
and/or threatening acts to further identify a psychological 
state of the author and how the author may react to the 
identified psychological state and at least one communication 
or message characteristic algorithm which analyzes the computer 
generated communication related to the psychological state 
and/or at least one possible action of the author. A plurality 
of analyses may be performed which are each algorithms; and the 
plurality of analyses may comprise a psychological profiling 
algorithm which provides an indication of a psychological state 
of the author, at least one key word algorithm which processes 
any phrases and/or threatening acts to further identify a 
psychological state of the author and how the author may react 
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to the identified psychological state and at least one message 
characteristicalgorithm which analyzes characteristics of the 
at least one computer generated communication to identify a 
psychological state and/or at least one possible action of the 
author. The output communication may be generated by the at 
least one processor by a report generator program which 
generates a report pertaining to the author. The input may be 
coupled to a communication system of an organization to which 
the author is affiliated and which collects the at least one 
computer generated communication produced or received by the 
one author; and the output communication may be directed to the 
organization indicating that at least one of an investigation 
and corrective action should be considered relative to the 
author. In the self -monitoring version, the output 
communication may be used to alter the at least one computer 
generated communication. The author may use the output 
communication to alter the at least one computer generated 
communication. The altering of the at least one computer 
generated communication may modify a psychological state 
reflected in the at least one computer generated communication 
in a manner desired by the author. 
[0072] 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0073] Fig. 1 illustrates the criteria utilized by 
Weintraub to identify and count the occurrence of words and 
word phrases to determine psychological states. 
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[0074] Figs. 2-7 illustrate slides presented by the 
inventor at conferences representing his analysis of electronic 
mail messages, after the occurrence of a crime, authored by 
the criminal before and during the time of the criminal 
activity. 

[0075] Fig. 8 illustrates a block diagram of a first 
embodiment of a computer system in accordance with the present 
invention utilized to analyze computer generated communications 
to produce output communications, such as warnings to 
organizations or groups to which an author of computer 
generated communications is affiliated. 

[0076] Fig. 9 illustrates a second embodiment of a 
computer system in accordance with the present invention used 
to analyze computer generated communications by the author 
thereof or another to provide recommended changes to the 
computer generated communications to alter the psychological 
state reflected therein before transmission thereof. 

[0077] Fig. 10 illustrates a workflow associated with the 
first and second embodiments of Figs. 8 and 9. 

[0078] Like parts are identified by like numbers 
throughout the drawings. 

[0079] 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
[0080] Fig- 8 illustrates a first embodiment 10 of a 
computer system in accordance with the present invention which 
is implemented in one or more processors 12 to detect, monitor 
and warn of the occurrence of psychological states, such as at 
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risk psychological states in computer generated communications 
of authors who transmit or receive computer generated 
communications, such as, but not limited to, email, chat, 
website content, etc. Computer generated communications have 
been recognized in the literature as having different 
characteristics than other forms of communication such as 
speech or publications. The first embodiment 10 is applicable 
to a wide range of applications involving group associations, 
such as companies, for whom an author of computer generated 
communications works or provides services. The at least one 
processor 12 is typically located on the site of the 
organization with whom the author, who transmits or receives 
computer generated communications, is affiliated but the 
invention is not limited thereto. The at least one 
processor 12 may be a server, PC or otherwise. The at least 
one processor 12 further may be a stand alone system or part of 
any existing system of a company which already monitors 
electronic mail and/or other computer generated communications. 
By combining the present invention with an existing system 
which monitors computer generated communications, parts of the 
existing system, such as a part which generates output 
communications and reports, may perform multiple tasks which 
lessens cost when compared to a stand alone system. A source 
of computer generated communications 14, which may be from any 
connection to the internet or diverse types of communication 
networks, or otherwise is a source of or destination of 
electronic mail, chat, web content, etc., which is analyzed by 
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the present invention. The invention applies the same analysis 
to computer generated communications which are transmitted or 
received by the author in association with the author's 
organization. 

[0081] A group of software modules 16, 18, 20, 22, 24, 2 6 
and 28 are executed by the at least one processor 12 as either 
part of a stand alone system or as part of an existing computer 
system containing at least one processor. These software 
modules implement the processes of the present invention and 
are fully programmable to define the criteria for conducting 
the analysis of the computer generated communications and the 
circumstances surrounding the generation of output 
communications and content thereof. 

[0082] The group of software modules includes a parser 
module 16 which identifies and tabulates words and word phrases 
present in the at least one computer generated communication to 
or from source 14 to identify categories of information 
therein. The parser module 16 analyzes the content of each of 
the computer generated communications to or from source 14 for 
keywords and phrases and message characteristics which are 
identified, counted and recorded. The results of this analysis 
are forwarded to database and statistical module 18 where the 
aforementioned identified, counted and recorded words, phrases 
and message characteristics are stored in the form of a 
spreadsheet or otherwise assigned to each author being studied 
regardless of whether or not the author is a receiver or an 
originator thereof. The database and statistical module 18 



32 



assigns the information to specific database categories of 
information in preparation for analysis by the three analytical 
modules 20, 2 2 and 24. The module 20 includes at least one 
psychological profiling algorithm which provides an indication 
of a psychological state of the author. The module 2 2 includes 
at least one personal and organization keyword algorithm which 
processes any phrases and/ or threatening acts to further 
identify the psychological state of the author and how the 
author may react to the identified psychological state. The 
module 24 includes at least one message characteristic 
algorithm which analyzes characteristics of at least one 
computer generated communication (attributes of the 
communication and not the meaning of informational content 
thereof) to further identify a psychological state and/ or at 
least one possible action of the author. 

[0083] The modules 20, 22 and 24 apply their algorithms 
to the data stored in the database and statistical module 18 to 
quantify at least one type of information in each category of 
information identified by parsing the at least one computer 
generated communication. The modules 20, 22 and 24 further 
apply their algorithms to the data contained in the database 
and statistical module 18 to statistically compare the results 
of the current computer generated communication to a fully 
programmable criteria for each of the categories of information 
produced by each of the modules. The fully programmable 
criteria may be an average, mean, other calculation or 
otherwise values representing the past computer generated 
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communications which are a reference which is compared with 
values obtained by use of the fully programmable criteria 
applied to a current computer generated communication. 
Alternatively, absolute values, which are fully programmable, 
are used as the reference compared to values obtained by use of 
the fully programmable criteria applied to the current computer 
generated communication. The absolute screening criteria are 
intended to indicate when a sufficient deviation exists from a 
normal psychological state that a warning or other output 
communication should be generated immediately based upon only 
the content of the current computer generated communication. 
When the difference between the fully programmable reference 
criteria and the current computer generated communication 
indicates a psychological state of the author or a change 
therein to which a responsive action should be taken, reporting 
and warning generator 2 6 and output generator 2 8 generate the 
programmed output communication. The database and statistical 
module 18 works in association with a report and warning 
generator 2 6 and an output generator 28. The report and 
warning generator 2 6 and output generator 28 which generates an 
output communication when the guantif ication of at least one 
type of information for at least one category differs from the 
programmed reference for the at least one category by at least 
a set, programmable or calculated criteria (mean, average or 
other calculation) indicating a psychological state in response 
to which a responsive action should be taken. The content of 
the output communication and the at least one category are 
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programmable to provide operator control over the detection of 
the actual psychological state or change therein in response to 
which an action should be taken. The results of the analysis 
performed by the database and statistical module 18 are sent to 
the reporting and warning module 2 6 and then to the output 
generator 28 when an output communication, in accordance with 
the programming selected by an operator is required such as, 
but not limited to, a warning is required to be provided to the 
user or agent thereof. 

[0084] The module 2 0 containing at least one 
psychological profiling algorithm measures the psychological 
and typically the emotional state of the author especially with 
regard to anger, fear, depression and anxiety. The results 
produced by the at least one psychological profiling algorithm 
are sent to the reporting and warning generator 2 6 and output 
generator 28 via the database and statistical module 18. 

[0085] The module 22 containing at least one personal and 
organizational keyword algorithm compares the number and type 
of alert phrases associated with specific acts contained in the 
current computer generated communication to the reference which 
may be either an absolute threshold limit to be applied to 
analysis of that communication or to an average, mean, 
calculated or otherwise values produced from previous computer 
generated communications. The results of the at least one 
personal and organizational keyword algorithm are sent via the 
database and statistical module 18 to the reporting and warning 
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generator 2 5 and to the output generator 2 8 when an output is 
necessary . 

[0086] The at least one message characteristic 
algorithm 24 compares the type and number of message 
characteristic variables in at least one computer generated 
communication (not the meaning of the content of the message 
thereof) to the reference which may be either the absolute 
limit programmed for the current communication or the average, 
mean, calculated or otherwise values produced from previous 
communications to determine when an output communication should 
be generated. The results of the at least one message 
characteristic algorithm 2 4 are sent to the report and warning 
generator 2 6 and to the output generator 2 8 via the database 
and statistical module 18. The report and warning generator 2 6 
and the output generator 2 8 function to generate an output 
communication when a difference between the quantification of 
at least one type of information for at least one category 
produced by modules 20, 22 and 24 and a reference is detected 
involving a psychological state of the author to which a 
responsive action should be taken with content of the output 
communication and the at least one category being programmable 
to define a psychological state in response to which an action 
should be taken and what the action is to be taken in response 
to the defined psychological state. 

[0087] The reporting and warning module 2 6 performs two 
analytical functions in addition to its reporting tasks. 
First, the reporting and warning module 2 6 examines a pattern 
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of results provided by the at least one algorithm of the 
modules 20, 22 and 24 to determine what type and level of risk, 
if any, is present as represented by a current computer 
generated communication. Second, the reporting and warning 
module 2 6 compares the results to either the dynamic and/ or 
static programmable criteria involving a psychological state of 
the author under the control of a user, such as a company or 
other organization to determine whether the level of risk 
detected in a current computer generated communication meets 
warning reporting criteria for which it is desirable to produce 
a programmed output communication by output generator 28 
including where, how and to whom the output communication is to 
be provided. If the criteria involving a psychological state 
of the author for reporting a warning are met, the output 
indicator 2 8 produces the aforementioned output including the 
results of the analysis and recommended actions to be taken 
according to a programmable format selected by the user. The 
recommended actions may and often will include a recommendation 
for further, more specific analysis of the results produced by 
the modules 20, 22 and 24 leading to the generation of a 
warning by a qualified professional, such as an on-call 
specialist. The on-call specialist may be provided access 
(not illustrated) to the database and statistical module 18 to 
conduct further analysis of the data generating the warning and 
to make further recommendations. 

[0088] In examining a pattern of results provided by the 
modules 20, 2 2 and 24, the reporting and warning generator 26 
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executes several threat assessment algorithms. For example, a 
determination may be made whether the reported changes occurred 
in only one of the three analytic modules. In such a case, 
there may be a significant change in the emotional state of an 
author detected by module 2 0 (e.g. increased anger) without 
requiring any report of alert phrases or key phrases associated 
with a threat of destructive action. In addition, the overall 
pattern of recipients and other characteristics of the author ' s 
messages (frequency, length, time of day sent, errors, etc.) 
analyzed by module 24 may have remained stable. The user may 
choose to have data on the results for each module 20, 2 2 and 
24 reported separately and/ or may choose to have the results of 
all three modules synthesized into a threat warning indicator 
which weighs the importance of any indication of the at least 
one type of information in any, some, or all, of the three 
categories of information in at least one computer generated 
communication. In the above example, the results of the change 
in emotional state could be reported alone and/or in an overall 
warning index. The level of warning reported by this index is 
lower than warnings resulting from increases in alert phrases 
detected by module 2 2 or significant alterations in the 
author's pattern of message characteristics detected by 
module 24. 

[0089] An example of a higher level of warning indication 
is that the results from significant changes in two or three of 
the analytical modules 20, 22 and 24 are detected. For 
example, a significant increase in author anger and fear 
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(according to change threshold levels which are the references 
used during determination if a sufficient difference exists to 
warrant the generation of an output set in consultation with 
the user) in the module 2 0 may be accompanied by specific 
references to attacks detected by module 2 2 on personnel or 
assets, veiled threats ("big surprise", "rude awakening", etc- 
or a desire for revenge which exceed the reference for the at 
least one criteria. In addition, this result may be 
accompanied by an increase in the frequency and length of the 
messages to a specific individual (e.g., the author's 
supervisor) detected in the module 24 which exceed the 
reference. 

[0090] The warning and reporting generator 26, according 
to user programmed preference (s) , reports significant changes 
in each module and/or reports the existence of a significantly 
higher threat index synthesizing these results. In addition, 
in the case when changes are detected by multiple modules, the 
reporting and warning generator 2 6 automatically extracts and 
reports salient threat data from each category of information. 
In the example above, this includes information on the type of 
psychological changes recorded, specific threatening key words 
or alert phrases recorded and an increase in the frequency and 
length of messages to the author's supervisor or other 
recipients containing these modules. 

[0091] The module 20 which provides psychological 
profiling is derived in part from the work of Weintraub as 
published in 1981, 1986 and 1989 and generally as described 
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above. The quantification procedures for the algorithms are in 
accordance with Weintraub's criteria but are applied to 
applications not discussed by Weintraub. While Weintraub's 
algorithms are utilized, they are applied in a new manner to a 
new medium (computer generated communications) with new 
subjects in the method and computer system of the invention. 
The use of Weintraub algorithms in a computer implementation 
generating real time analysis and output communication differs 
from their use in the prior art regarding: the subjects 
examined (Weintraub never applied his algorithms to employees 
or other normal subjects) ; the medium of communication examined 
(Weintraub applied his algorithms to speeches and interviews) ; 
not to computer generated communications including dynamic 
profiles (Weintraub constructed only static profiles of 
political leaders) ; and use for generating a warning (Weintraub 
never used his algorithms to produce a warning about the 
existence of a dangerous psychological state associated with an 
increased risk of an employee damaging himself, others, or the 
interests of the employer) . Furthermore, the Weintraub 
algorithms have not been used in combination with key word and 
message characteristic algorithms in a computer implemented 
system generating real time analysis and output communication. 

[0092] Additionally, the algorithms in module 20 include 
two new categories of key word phrases which are emphatics and 
email symbols which are quantified in addition to the 
categories of Weintraub's algorithm which are quantified. 
Emphatics include words written in bold face or italics and 
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profanity. Specialized email symbols include signs used to 
express specific emotions, such as smiling or frowning faces. 
These two categories represent conditions common to email which 
have not been considered by Weintraub because his work being 
with different subjects in a different modality. 

[0093] The module 22 executes at least one personal and 
organizational keyword algorithm which analyzes key words and 
phrases. Expressed in connection to an individual or 
organizational characteristic, policy, or practice, key words 
provide greater evidence that a potentially dangerous emotional 
state detected in the at least one psychological profiling 
algorithm may be connected to an individual or an organization. 
These key words or alert phrases include the categories of 
expressions of anger, expressions of grief, threats and 
accusations. The module 2 2 quantifies words in these 
categories to generate a total score of all of the words 
determined to be within this category which are compared to the 
reference which may be programmed or determined from an 
average, mean, other calculation or otherwise from previous 
computer generated communications to determine if an output 
communication should be generated. 

[0094] Examples of key words and alert phrases without 
limitation include: anger, e.g. hate, despise or resent, 
garbage, screwed, unfair, protest, resist, pissed, rage, 
hostility, etc.; grief, e.g. loss, sad, can't help, remove, 
take away, forever, never the same, death, separation, move, 
gone, destroyed, ruined, etc.; threats, e.g. big surprise. 
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shock, what's coming, quit, hack, fire, you'll regret, take 
down, get even, sue, lawsuit, publish, punish, kill, hurt, 
steal, etc.; and accusations, e.g. accuse, punish, set-up, 
arranged, conspired, planned attack, force out, demote, 
transfer, undermine, etc. These key words or alert phrases 
have been found in prior attacks by insiders. They connect an 
author's negative emotional state to a specific possible action 
toward an individual and/or organization increasing the 
predictive capability of the present invention when connected 
with the other algorithms. 

[0095] While key word analysis has been used, such as 
ordered by the Securities and Exchange Commission regarding 
broker email, key word analysis has not been used with respect 
to analysis specific to employee attitudes and actions toward 
individuals or organization's or their interests; the use of 
key words specifically derived from and tailored to insider 
violations involving fellow employees and organizational 
interests; the use of key words collected over time from a 
single individual rather than a one-shot, static detection 
strategy that results in a warning from a single key word 
occurrence; and the use of key words in combination with 
psychological profiling data and message characteristic 
indicators in a computer implemented system in order to develop 
a more specific sensitive, valid and reliable indicator of risk 
or other situations reflected in computer generated 
communications to which a responsive action is desirable. 
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[0096] The at least one message characteristic algorithm 
in the module 24 analyzes attributes of the communication 
itself rather than the meaning of the content that provides 
psychological information. These characteristics or attributes 
include the number of words (depressed individuals tend to be 
less productive while individuals have been shown by research 
to be more productive) ; time of day (alterations in the time of 
day an author chooses to communicate can have significance in 
that depressed or upset individuals tend to develop insomnia 
and experience variation in their moods according to time of 
day) ; writing time or words per minute (concentration and motor 
speed are extremely sensitive to changes in psychological and 
cognitive state, as well as the presence of psycho-active 
agents) (Shaw 1986-1987) with changes in words per minute 
therefore being a key indicator for depression, anxiety and 
anger, drug use or other potentially risky changes in an 
individual; recipient (it is important to determine whether the 
person to whom the subject is directing the computer generated 
communication to has changed, the number of recipients has been 
altered, or if the psychological content of the message varies 
according to the recipient with this information being vital to 
locating a source of interpersonal conflicts) ; spelling and 
grammatical errors (changes thereof are an excellent indicator 
of concentration, attention and cognitive integrity, all of 
which may be affected by stress, illness, drugs or extreme 
emotional states) ; words per sentence (abbreviation or 
expansion in the efficiency of communications as an indicator 
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of psychological state, especially anger, anxiety and 
depression) ; and communications rate (communications per hour 
and day as an indicator of productivity which can be affected 
by psychological state) . These attributes had been previously 
measured but have not been applied to a computer implemented 
system in combination with psychological profiling and key word 
analysis to produce a warning and provide information regarding 
characteristics in an employee population. The module 2 2 
quantifies variables in these categories to generate a total 
score of all of the data determined to be within this category 
which are compared to the reference which may be a programmed 
absolute value or determined from an average, mean, other 
calculation or otherwise from previous computer generated 
communications to determine if an output communication should 
be generated. 

[0097] Fig. 9 illustrates a second embodiment 100 of a 
computer system in accordance with the present invention which 
is also implemented in one or more processors 12 . The second 
embodiment 100 differs in functionality from the first 
embodiment 10 in that it is primarily, but not necessarily, 
used for self-monitoring by or of the author of computer 
generated communications in order to allow the author or user 
to assess a psychological state reflected in the proposed 
computer generated author's communications. The output 
communication is generated when a difference between the 
quantification of at least one type of information for the at 
least one category produced by the psychological profiling 
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algorithm of module 2 0 and the programmable reference or a 
reference obtained from an average, mean, other calculation or 
otherwise of previous communications is detected involving a 
psychological state of the author to which a responsive action 
should be taken with the content of the output communication 
and the at least one category being programmable to define a 
psychological state in response to which an action should be 
taken and what the action is to be taken in response to a 
defined psychological state. 

[0098] The embodiment 100 produces graphic or tabular 
ratings of the contents of a work product scored for emotional 
tone. Emotional scales for embodiment 100 include ratings of 
the levels of such emotions as anger or hostility, 
decisiveness, passivity, self-confidence, complexity, sadness 
or happiness, etc. After completion of a computer generated 
communication, the author has the option of engaging the 
embodiment much in the same way a spell or grammar checker is 
used to obtain an evaluation thereof and possible corrective 
action to alter the emotional tone. The default position of the 
system includes standard scales but the user also has the 
option to select or eliminate specialized scales by programming 
that may be of relevance to the target audience or of personal 
concern. 

[009 9] After the ratings of the work product are 
complete, the embodiment 100 produces recommendations for 
corrections designed to increase or reduce levels of various 
emotions. For example, a computer generated communication high 
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on hostility may produce a recommendation to reduce the number 
of negatives while highlighting their location within the text. 
A computer generated communication high on indecisiveness may 
recommend the reduction of the number of qualifiers and 
retractors also highlighting their location in the text. The 
author then has the option to re-run the rating system to check 
for improvement in the desired fully programmable emotional 
scales . 

[0100] A typical psychological state to which responsive 
action should be taken is when the content of a proposed 
computer generated communication would have a negative effect 
on a recipient (s) . A typical suggested action is suggestions 
in the output communication of how to lessen the undesired 
impact of the proposed computer generated communications of the 
author (e.g. email) . The content of the proposed computer 
generated communication is typically altered to improve the 
desired impact of the communication. For example, the proposed 
computer generated output communication is designed to insure 
that the proposed computer generated communication does not 
display excessive anger, indecisiveness, rigidity or other 
characteristics designated by the user as undesirable in the 
programming of the criteria for determining when a responsive 
action should be taken. The user may also utilize the 
embodiment 100 to assess or modify the psychological 
characteristics presented in a desired direction, such as to 
increase or decrease a negative psychological state reflected 
in a proposed email. The embodiment 100 parses and assesses 



46 



these characteristics and actively assists the user to alter 
them through specific recommendations which are fully 
programmable to provide versatility in use of the embodiment 
with different personalities and screening different types of 
communications . 

[0101] The same psychological profiling algorithm 22 is 
used which is used in the embodiment 10 described above in 
association with Fig. 8. In the embodiment 100, at least one 
computer generated communication is parsed and analyzed to 
produce a determination of the author's psychological state. 
Additionally, hypotheses regarding the author's psychological 
characteristics reflected in the computer generated 
communication for the author or user are determined. As the 
embodiment 100 gathers more data through the analysis of 
computer generated communications of a user or outside author, 
such communications may be stored and utilized to improve the 
validity of assessment of the author through use of additional 
data. This allows the embodiment ICQ to analyze changes in 
psychological characteristics of the person involved, which is 
typically the author of the computer generated communication, 
but is not limited thereto. The operation of the parser 16, 
database and statistical module 18 and the module 2 2 containing 
at least one psychological profiling algorithm is similar to 
the embodiment 10, except for its application being designed to 
provide self -monitoring or monitoring of an individual without 
the primary beneficiary of the suggested action being an 
organization to which the author is affiliated. 
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[0102] The module 2 2 in the embodiment 100 utilizes the 
analytical algorithms to evaluate the psychological state and 
characteristics of the author requested by the user. This may 
involve analysis of a single communication to see if the 
quantification of the words of the computer generated 
communication exceeds a programmable reference set by the user 
or someone else or a comparison of the quantification of the 
criteria being investigated in the current communication 
differs from a reference determined from one or more previous 
communications of the same author or different authors which 
are used as a basis to determine if an output communication 
should be generated. In addition, the psychological measures 
derived from the current communication may be compared to the 
statistical values derived from an analysis of a subset of 
previous authored communications or even all previous authored 
communications. This capability allows the user to assess 
changes in an author's psychological state or characteristics 
over time. In the self -monitoring mode of the embodiment 100, 
the user evaluates the effects of alterations in the content of 
their own communications. 

[0103] The results of analysis performed by the module 2 0 
are transferred through the database and statistical module 18 
to the report generator and editor 3 0 where results are 
delivered to the user in a format selected and programmed by 
the user. In the self -monitoring mode, the user may select 
indices of preselected psychological characteristics such as 
hostility, assertiveness, flexibility, passivity, complexity, 
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etc. The user may then query the system for the actual basis 
of these judgments and may obtain suggestions for altering 
these values. For example, if the embodiment 100 generates a 
scale hostility score of 8 on a scale of 0-10, the user is told 
the basis for the score, e.g. a relatively high level of 
negative phrases, such as not, no, never, etc. The user is 
then offered suggestions for lowering this score (e.g. by 
reducing the number of negative phrases which the system 
locates and identifies) . After altering the suggested content, 
the user then may repeat the analysis of the computer generated 
communication to determine the effect of editing on the 
emotional or psychological state reflected therein so as to 
permit variation in the impact of the computer generated 
communication as measured by the quantification produced by the 
psychological profiling algorithms in the module 20. 

[0104] The embodiment 100 also uses the emphatics and 
email symbols in module 22 described above with respect to the 
embodiment 10 of Fig. 8. 

[0105] A range of single and composite score 
interpretations based upon the above-described score 
interpretations of Weintraub, may be utilized in a 
determination of the psychological state of the author with the 
embodiment 10 for applications, such as employee monitoring for 
follow-up or more in-depth assessments by qualified personnel 
and with the embodiment 100 to provide more specialized forms 
of analysis, including self -analysis, that may be selected. 
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[0106] Another algorithm which is used by the 
embodiments 10 and 100 to generate the output communications is 
Psychological Distance as described above. This measure is 
derived from the work of Mehrabian and Weiner (1966) . 

[0107] Fig. 10 illustrates a workflow of the processing 
performed by the at least one processor 12 of the 
embodiments 10 and 100 of Figs. 8 and 9 which may be utilized. 
However, it should be understood that the invention is not 
limited thereto. Workflow begins at 200 with a new document to 
be analyzed which is a computer generated communication. The 
new document, provided in digital format, is forwarded at 2 02 
to a document management subsystem. Groups of documents are 
organized at 2 04 in a database as indicated so that the 
organization is, without limitation, by author, date, location, 
recipient and time. The analysis of an individual document 
begins at 2 06 where a document stored in the database 2 04 is 
selected. The selected document is forwarded at 2 08 to a rule 
editor subsystem where the user is provided selectivity of the 
rule set used to program the operation of the parser 16. The 
rule editor subsystem 2 08 passes the selected document to 
language parser 16 which may be in accordance with any well- 
known text analyzer to perform the guantif ication as described 
above used with respect to the modules 20, 22 and 24. 

[0108] The language parser 16 deconstructs the document 
to identify categories of information therein as described 
above for each of the categories of information analyzed by the 
modules 20, 22 and 24. The language parser 16 passes the 
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deconstructed document to an analysis engine 212 to apply the 
selected rule set and to perform the programmed scoring 
calculations (quantifications) involving each of the identified 
categories of information to quantify at least one type of 
information in each category which are numerically scored- The 
results of processing of the analysis engine 212 are passed to 
the scoring database 214 where the individual scores are saved 
and summarized, such as producing the mean, average, etc. of 
all past computer generated communications used as the 
reference for each category so as to facilitate comparison to a 
current computer generated communication. The results of the 
scoring database 214 are passed to the reporting and warning 
generator 2 6 and output generator 28 or to report generator and 
editor 3 0 which each generate reports and communications 
regarding a responsive action which should be taken. 
Optionally, a professional, such as an analyst, is provided at 
218 with the output from the reporting and warning system 2 6 
and output generator 28 or the report generator and editor 3 0 
to permit comments and notes of the analyst to be stored so as 
to provide responsive action to the results of the reports. 
[0109] 

A Case Example 

[0110] This case below illustrates operation of the 
invention, including how the output communication appears and 
is applied. At the outset, emails or other computerized 
communications are scanned for the selected words and values 
utilized in the three categories 20, 22 and 24 of algorithms — 
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psychological profiling, key words and message characteristics 
as described above. These values are preferably assembled on a 
single spreadsheet for each email produced by a subject. As 
additional emails are collected, an additional spreadsheet is 
constructed containing mean scores and other values for all 
collected emails for a subject. The analytical algorithms are 
then applied to the data in the spreadsheets to construct 
critical scores. 

[0111] For some of the more advanced psychological 
profiling variables it is often desirable to apply a correction 
factor that accounts for the difference in the number of words 
per computer generated communication. For example, if there is 
interest in determining whether a subject's error rate is 
changing as a function of decline in concentration and 
attention, it is often useful to score typing or grammatical 
errors per 1000 words. This correction factor is also useful 
when two or more different authors are being compared or an 
author is being compared to others within the work or peer 
group. However, in most comparisons of an individual over 
time, the number of words produced, per se, is an important 
indicator of a subject's psychological state and is not 
corrected for. 

[0112] The values in Table A below are taken from actual 
emails between a computer crime perpetrator and his supervisor 
which are the basis for Figs. 2-7. In this example, the 
invention draws from the message characteristics category to 
select only messages from the criminal to his supervisor. 
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Table A contains two sets of actual scores that the system 
selects from its spreadsheets for an author to assess levels of 
anger — number of negative phrases, evaluators, and alert 
phrases as a first score and the number of words per email and 
the frequency of email messages to a selected recipient. As 
determined, typically in collaboration with the user, scores 
for other psychological characteristics may also be assessed by 
selectively drawing on the values in the spreadsheet from which 
these scores are constructed. The first column contains the 
mean values for six previous emails collected by the 
investigator three months prior to the criminal attack. The 
second column contains the same selected scores for an email 
collected on April 10^'" when the criminal's relationship with 
his supervisor began to deteriorate and he became noticeably 
disgruntled - 

[0113] This example is illustrative of the most common 
analytical task to be performed by the invention — detecting and 
assessing on a real-time basis the extent of any changes in the 
subject's psychological state from these psycholinguistic 
values followed by a computer generated output providing a 
course of action to permit a responsive action to be taken to 
head off later problems or potential risks. The threshold 
reference for signaling the existence of such changes may be 
determined in consultation with the user, such as a customer, 
and is fully programmable. Statistical values, percentage 
increases or target values derived from actual case studies 
such as that below may be utilized. 
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[0114] In Table A it is clear that the increases 
contained in the April 10^^ email represent about double the 
previous mean values. 



54 



[0115] 



TABLE A 



Table A. Example Scores Generating a Systenn Warning 



Mean Scores for Previous Emails Score for April 10 Email 



Negatives 
Evaluators 
Alert Phrases 
Number of Words 
Messages per week 



7 
18 
0 

270 
1 



17 

35 
7 

560 
6 



To Target 



This data leaves little doubt of the importance of the change 
in the criminal's psychological (emotional) state. 

[0116] In this case, the invention produces a warning 
output communication containing three types of information. 
First, a general warning is issued identifying that there has 
been a significant change in the scores of the author. This 
change is then characterized as an increase in the 
psychological state of anger. Second, the user is offered the 
option of further inquiry to break the general anger warning 
down into its component parts. In this case, the data in Table 
A are reviewed along with a textual description of its meaning 
and interpretation. 

[0117] An example of a textual description is as follows: 

The warning you have received was based on the 
following information. Mr. Smith's email message to 
his supervisor, Ms. Brown of April lO^*" contained an 
increase from his baseline in several measures 
associated with anger. There was an increase of 24 0% 
in negative phrases such as "no, not, never, etc." 
which are associated with general negativity and 
opposition. There was an increase of 94% in his use 
of evaluators— phrases that make strong judgements 
about right or wrong or other personal values. An 
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increase in evaluators is often associated with 
strong feelings about a subject and indicative of 
increased rigidness. In addition, there was an 
increase of 107% in the number of words in this 
email. Increases in number of words per email in 
this context may indicate emotional arousal. The 
number of emails Mr. Smith sends to his supervisor, 
Ms. Brown, also increased by 500% indicating an 
unusual increase in his attention to her within the 
last week. Finally, Mr. Smith's email to Ms. Brown 
contained the following seven alert phrases: "big 
surprise, quit, fire, garbage, screw-up, relieve me 
of my duties, and damage." 

[0118] Second, the user is given the option of isolating 
the specific words and phrases that generated these warnings. 
In addition, the original emails may be retrieved from the 
database and statistical module 18. 

[0119] Third, the invention also generates options and 
recommendations for the user, designed for the organization of 
the user. These options and recommendations are fully 
programmable . 

[012 0] Table B below illustrates some of the possible 
types of options and recommendation output (s) that may be 
programmed in a warning output communication. These may be 
issued individually or in combination. That is there may be 
circumstances where more than one output applies. 

[0121] 

Table B. Examples of Fully Programmable 
Option and Recommendation Output 
[0122] 1. Advise security, law enforcement and legal counsel 
of concerns immediately. This output is generated by 
psychological profiling variables indicative of the possible 
presence of anger and/or disorganization, key words indicating 
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the risk of violence and message characteristics indicating a 
possible target for this action. 

[0123] 2. Notify a medical/psychological professional or 
employee assistance program of our concern about the author. 
This output is generated by psychological profiling variables 
indicating the possible presence of psychopathology , including 
depression, cognitive or emotional instability or other 
problems, and key words and message characteristics indicating 
behaviors accompanying this state (suicidal ideas, a marked 
decrease in message freguency, an increase in error rates, 
decreases in typing speed indicating difficulties with 
concentration and attention, etc.) 

[012 4] 3. Query the author's supervisor regarding the 
author's recent behavior. This output communication is 
generated when signs of change in psychological profiling 
variables and message characteristics indicative of 
psychological difficulties not approaching major 
psychopathology and keywords that do not indicate major 
immediate risks of harm to the employee or others are detected. 

[0125] 4. Notify a professional profiling analyst of the 
electronic generated communications of concern about the 
employee and requests further analysis or assistance. This 
output communication is generated if the user desires more 
advanced analysis of the employee's communication and advice on 
management of the employee. This output communication may be 
generated when concerns regarding espionage, sabotage. 



57 



intellectual property violations, deception or other potential 
violations are suspected. 

[0126] This analytical process is repeated many times per 
email depending upon the programmable psychological changes 
targeted by the user to be monitored and to which corrective 
action may be desirable. As described above, possible 
programmable psychological target changes, in addition to anger 
include, without limitation, anxiety or depression. Alert 
phrases may also be designed to target these psychological 
states as well as words associated with specific threats. 

[012 7] In addition to detecting and analyzing changes in 
an author, the system can also be utilized to create warnings 
when values on key variables reach or exceed specific threshold 
reference levels, independent of any changes. These may 
include psychological profiling values, key words or alert 
phrases or message characteristics. These values are typically 
derived in collaboration with the user and are tailored to the 
specific work environment which are then programmed into the 
operation of the system. They may also be based on parameters 
derived from past episodes of computer or other violations. 

[0128] For example, below is a portion of the email from 
the computer crime perpetrator which is the basis for Figs. 2-7 
cited above. Table C gives examples from each of the three 
categories of values which could be used to trigger an warning 
based on the occurrence of a single communication. 

[0129] 

"Until you fire me or I quit, I have to take orders from 
you... Unless he is a trained expert, I won't give him 
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access... If you order me to give him root access, then you 
have to permanently relieve me of my duties on that 
machine. I won't be garbage cleaner if someone screws 
up.... I won't compromise on that." 

[0130] 

Table C. Examples of Single Message Warning Values 
Psvcholocfical Profiling Variables 

Negatives per words . 03 

Me per words .02 

Evaluators per words .06 

Alert Phrases fire, quit, garbage, root access 
Message Characteristics 

Message length 550 words 

[0131] As can be seen from the text, there are an unusual 
number of negatives and evaluators in this excerpt reflecting 
anger and value judgements, respectively. The normal values of 
negatives and evaluators vary by subject group but are 
typically lower by a factor of 50-100%. In addition, on 
average individuals produce only one "me" per 1,000 words. 
"Me" can only be used in a passive position in a sentence, 
indicating that the author is the recipient of action from the 
environment. High rates of "me" are often associated with the 
feelings of victimization perpetrators express prior to their 
acts. Finally, the length of an average email can vary from 
location to location and is best established for each customer. 
However, the average email length is approximately 2 50 words. 
A message of twice that length can indicate expansiveness 
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characteristic of anger and could also serve as a warning 
indicator. While the above examples are included for 
illustrative purposes of an application of the invention, 
specific constellations of values are typically constructed to 
serve as warning indicators from a much larger pool of 
available variables in accordance with the invention. The 
programming of the modules of the embodiments used in the 
practice of the invention may be in accordance with any known 
technological and programming language. 

[0132] While the present invention has been described in 
terms of the preferred embodiments, it should be understood 
that numerous modifications may be made thereto. It is 
intended that all such modifications fall within the scope of 
the appended claims. 
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